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Abstract 

Nonlinear systems with model uncertainty are often described by 
stochastic differential equations. Some techniques from random dy- 
namical systems are discussed. They are relevant to better under- 
standing of solution processes of stochastic differential equations and 
thus may shed lights on predictability in nonlinear systems with model 
uncertainty 
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1 Introduction 

Nonlinear systems are often influenced by random fluctuations such as, un- 
certainty in specifying initial conditions or boundary conditions, external 
random forcing, and fluctuating parameters. In building mathematical mod- 
els for these nonlinear systems, sometimes, if not often, less-known, less well- 
understood, or less well-observed processes (e.g., highly fluctuating fast or 
small scale processes) are ignored due to limitations in our analytical ability 
or computational power. 

The limitation of predicting dynamical behavior in nonlinear systems 
due to uncertainty in initial condition has been widely investigated |33j . 
This present article discusses model uncertainty in nonlinear systems. This 
issue has attracted a lot of attention in geophysical community [21 [661 [Ml 
[26l[27l[77l[60l[78l[l9l[32l[l5]. 

The uncertainties in simulation may also be regarded as a kind of model 
uncertainty. This arises in numerical simulations of multiscale systems that 
display a wide range of spatial and temporal scales, with no clear scale 
separation. Due to the limitations of computer power, at present and for 
the conceivable future, not all scales of variability can be explicitly simulated 
or resolved. Although these unresolved scales may be very small or very fast, 
their long time impact on the resolved simulation may be delicate (i.e., may 
be negligible or may have significant effects, or in other words, uncertain). 
Thus, to take the effects of unresolved scales on the resolved scales into 
account, representations or parameterizations of these effects are required 

Stochastic parameterization of unresolved scales or unresolved processes 
leads to stochastic dynamical models in weather and climate prediction [691 
[Ml[5Ql[39l[l6l[35l[6l[l3l[Sl[Hl[23l[86l[Ml[9^ 

It has been a recent research focus in the dynamical systems community 
for better understanding the solution orbits of stochastic dynamical models 
[ll[I71[65l[ll[l8l[76l[30l[9l]. This is relevant to the issue of predictability 
under uncertainty in nonlinear systems, which concerns about factors and 
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mechanisms for uncertainties of forecasts and techniques for quantifying 
and reducing these uncertainties [MIEHlESllIIlESlllSlElllHHIlin]- Various 
measures have been proposed in quantifying predictabihty [171 [52l [58l [80] . 
and the impact of measure selection on prediction results has also been 
discussed [B7] . 

We consider the following stochastic system defined by Ito stochastic 
differential equations (SDEs) in W^: 

dXt = b{Xt)dt + a{Xt)dWit), X{0)=xo, (!) 

where b and a are vector and matrix functions, taking values in M" and 
^nxm^ respectively. The standard vector Brownian motion W{t) takes 
values in M™. Note that n and m may be equal or different. We treat 
X,Xt,X{t) or Xt{uj) as the same random quantity. 

The noise term adWt may be regarded as model uncertainty or model 
error. It could be caused by external fluctuations or random influences, or 
by a fluctuating coefficients or parameter in the model. Stochastic param- 
eterization of unresolved scales or unresolved processes leads to stochastic 
dynamical systems (691 EOl [231 [931 [92] . Moreover, numerical simulation of 
stochastic partial differential equations may also lead to SDEs [Ml [Z5] • 

The Brownian motion W{t), or also denoted as Wt, is a Gaussian stochas- 
tic process on a underlying probability space {Q,J-,¥), where is a sample 
space, JP" is a u— field composed of measurable subsets of Q (called "events"), 
and P is a probability (also called probability measure). Being a Gaussian 
process, Wt is characterized by its mean vector (taking to be the zero vector) 
and its covariance operator, anxn symmetric positive definite matrix (tak- 
ing to be the identity matrix). More specifically, Wt satisfies the following 
conditions |65j : 

(a) W(0)=0, a.s. 

(b) W has continuous paths or trajectories, a.s. 

(c) W has independent increments, 

(d) W(t)-W(s) ~ iV(0, (t - s)I), t and s > and t> s>0, where / is the 
n X n identity matrix. 

Remark 1. (i) The covariance operator here is a constant n x n identity 
matrix I , i.e., Q = I and Tr{Q) = n. 

(ii) From now on, we consider two-sided Brownian motion Wt, t G R, 
by means of two independent usual Brownian motions Wt and Wt (t > 0): 
For t>0,Wt := W^, while for t<0,Wt := Wlf 

(Hi) W(t) ~ A^(0, |t|/), i.e., W{t) has probability density function pt{x) = 

- — -T7-e 2t 

(27rt) T 
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(iv) For every a G (0, 2); for a.e. lo € there exists C{(jj) such that 

\W{t,uj) - W{S,L0)\ < C{Lo)\t - s\", 

namely, Brownian paths are Holder continuous with exponent less than one 
half. 

The Euclidean space has the usual distance d{x, y) = ^jYl]=ii^j ~ VjY^ 

norm ||a;|| = ^Yl^=i the scalar product x-y =< x,y >= Yl]=i^jyj- 

This article is organized as follows. After reviewing some basics about 
stochastic differential equations in ^ we discuss random dynamic systems 
in ^ Then we consider the impact of uncertainty and error growth in 
SI residence time, exit probability and predictability in ^ and invariant 
manifolds and predictability in ^ Finally, we discuss nonlinear systems 
under non-Gaussian noise and colored noise in ^and in ^ respectively. 



2 Stochastic differential equations 
2.1 Ito and Stratonovich calculus 

Note that the Stratonovich stochastic differential cr(X) o dW{t) and Ito 
stochastic differential a{X)dW{t) are interpreted through their correspond- 
ing definitions of stochastic integrals [65]: 

[ a{X) o dW{t) := mean-square lim V C7(X( ^^'+^ ^ , , -Wt ), 

Jo ^h-*^^ 2 

T 

:= mean-square lim ^a{X{tj)){Wt^^^ - Wt^). 

j 

Note the difference in the sums: In Stratonovich integral, the integrand is 
evaluated at the midpoint ^^+]^^^ of a subinterval while for Ito 

integral, the integrand is evaluated at the left end point tj. See [65] for the 
discussion about the difference in physical modeling by these two kinds of 
stochastic differential equations. There are also dynamical differences for 
these two type of stochastic equations, even at linear level |14j . 

If the integrand f{t,uj) is sufficiently smooth in time, e.g., Holder con- 
tinuous in time in mean-square norm, with exponent larger than 1, then 
both Ito and Stratonovich integrals coincide; See [65], p. 39. But in general, 
these two Ito and Stratonovich integrals differ. Note that Wt is only Holder 
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continuous in time [56] with exponent a < ^. So that is why the following 
stochastic integrals are different: 



£ WtdWt = ^{Wi-W^)-^{T-t), 
WtodWt = ]^{Wf -W^). 



Thus we have the two different kinds of SDEs of Ito and Stratonovich 
types: 

dX = h{X)dt + (T{X)dW{t), X{<d) = XQ, (2) 



dX = b{X)dt + a{X)odW{t), X{0)=xo, (3) 

However, systems of Stratonovich SDEs can be converted to Ito SDEs and 
vice versa [l8l[65]. In the following we only consider Ito type of SDEs. 

2.2 Ito's formula and product rule 

Ito's formula in 1— dimension (scalar case): 

Consider a scalar SDE (6, a and Wt are all scalars) 

dXt = b{Xt)dt + a{Xt)dWt. 

Let g{t, x) be a given (deterministic) scalar smooth function. 
Ito's formula in differential form is: 

dg{t,Xt) = [gt{t,Xt)+g.{t,Xt)b{Xt) + ^g,.{t, Xt)a\Xt)]dt + g.,{t, Xt)a{Xt)dWt. (4) 

The term ^g^xit, Xt)a'^{Xt) is called the Ito correction term. Symbolically, 
we may use the following rules in manipulating Ito differentials: 

dtdt = dtdWt = 0, dWtdWt = dt. 

Ito's formula in integral form is: 

ft I 
g{t,Xt) = g{0,Xo)+ / [gt{s,Xs) + gx{s,Xs) + -gxx{s,Xs)a^{Xs)]ds 

Jo ^ 

+ / gx{s,X,)a{Xs)dWs. (5) 

^0 
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The Generator A for this scalar SDE is 

1 2 
^9 = 9xh + -gxxry ■ 

Ito's formula in n— dimension (vector case): 

Consider a SDE system 

dXt = h{Xt)dt + a{Xt)dWt, 

where h is an n— dimensional vector function, o" is an n x m matrix function, 
and Wt{u)) is an m— dimensional Brownian motion. 

Let g{t,x) be a given (deterministic) scalar smooth function for x G M". 

Ito's formula in differential form is: 

dg{t,Xt) = {gt{t,Xt) + {Vg{t,Xt)fb+^Tr[aa^H{g)]{t,Xt)}dt 

+ {Vg{t,Xt)fa{Xt)dWt, (6) 

where denotes transpose matrix, H{g) = (gxiXj) is the n x n Hessian 
matrix, and Tr denotes the trace of a matrix. 
Generator A for this SDE system is, 

Ag = iVgfb + ^Tr[aaTD\g)], (7) 

where the gradient vector of g is \/g = (g^^ , gxn)^ ^^'^ nxn Hessian 
matrix of g is 

Symbolically we may also use the rules: 

dtdt = 0, dtdWt = 0, dWt ■ dWt = ndt = Tr{Q)dt 

Note that: Tr[Q) = n for n— dimensional Brownian motion Wt- 
Ito's formula in integral form is: 

g{t,Xt) = g{0,Xo)+ [\gt{s,Xs) + {Vg{s,Xs)fb+lTr[aa^H{g)]{s,Xs 

Jo ^ 



+ [\vg{s,Xs)fa{Xs)dWs. 
Jo 



Remark 2. For the above Ito's formula, a somewhat remote connection is 
the material derivative of the fluid velocity 

j^g{x,t)=dtg + u-Vg, (9) 
where u = x is the underlying driving flow. 
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Stochastic product rule: 

Taking g = xy for a two-dimensional SDE system, we get 



d{XtYt) = XtdYt + {dXt)Yt + dXtdYt (10) 



2.3 Estimation of Ito's integrals 
Ito isometry: 



E{[ f{t,L0)dWtf =E [ f\t,L0)dt (11) 

JO Jo 
Generalized Ito isometry: 



ra rb i-a/\h 

E{ f{t,u;)dWt g{t,u;)dWt)=E f{t,u;)g{t,u;)dt, (12) 
Jo Jo Jo 

where a Ab = min(a, b). 

Proof. Look at the case a = b. 

Denote h = f{t,uj)dWt and I2 = g{t,uj)dWt. Note that = 
^[{h + h)"^ ~ ~ ^2] ^^'^ use the isometry property. 

For a ^ b, say a < b, i.e.,min(a, 6) = a. Extend / to the time interval 
[a, b] by setting it zero there. Then apply the above proof. □ □ 

Ito isometry in vector case: 

Let F{t, u>) and G{t, uj) he n x n matrixes, and Wj be n— dimensional 
Brownian motion. 



ra pb /•a/\b 

E(/ F{t,uj)dWt)- { G{t,uj)dWt) =E Tr{GF^){t,uj)dt, (13) 
Jo Jo Jo 

where • denotes the usual scalar product in M", Tr denotes the trace of a 
matrix (i.e. the sum of diagonal entries of a matrix). 
In particular, 

pa pa 

E|| / F{t,uj)dWtf = E Tr{FF^){t,uj)dt, (14) 
Jo Jo 

pa pb paAb 

E(/ F{t,uj)dWt) ■ { F{t,uj)dWt) =E Tr{FF^){t,uj)dt. (15) 
Jo Jo Jo 
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Inequalities involving Ito's integrals: 

By the Ito isometry and the Doob martingale inequality ([65], p. 33), we 
have, for any constant A > 0, 



sup I f f{s,io)dW,\ > A) < r \f{s,io)\^ds. (16) 



to<t<T Jto Jto 

Arnold [1974], p.81: 



E( sup I f f{s,u;)dWs\^)<4E C \f{s,u:)\^ds. (17) 
to<t<T Jo Jto 

More generally. 



E| f' f{s,Lo)dWs\'"' < {k{2k - l))''~\t - to)>'-^E r \f{s,Lo)\^''ds. (18) 

2.4 Some examples 
Example 1. Langevan equation 

dXt = -bXtdt + adWt, (19) 

where a, b are real parameters, and the initial condition Xq ~ N(0, cr^). The 
solution is 

Xt = e-^^Xo + ae-^^ f e^'dWs- (20) 

JO 

Note that EXj = and Xt is a Gaussian process. 



CoviXs,Xt) = a2e-^('^+*) + ^[e"^!^"*! - e-'^'+% (21) 
Cov{Xo,Xt) = a'e-"' + ^[e"^!*! - e"^*], (22) 
VariXt) = ah-^'' + ^ " ^"''*] ' (^3) 
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C„iX.,X,)= , (24) 



When c = 1^, we have 



Cov{Xs,Xt) = a\-'>\'-'\ (25) 
Var{Xt) = ^. (26) 

Namely, in this case, Xf is a stationary process. 

Example 2. Stochastic population model 

Consider the following linear scalar SDE with multiplicative noise: 

dXt = rXtdt + aXtdWt, (27) 

where r and a are real constants, and Xt > 0,a.s.. Rewrite the SDE as 

dX 

-—^=rdt + adWt. (28) 

Applying the Ito formula to In Xf to obtain 

dX 1 

d{lnXt) = —^--a^dt. (29) 
At I 

That is, ^ = (i(lnXt) + \o?dt. Thus becomes 

d{\nXt) = (r - ^a'^)dt + adWt. (30) 



Integrating from to t. 



In^ = {r - la'^)t + aWt. 
Ao 2 



We hence get the final solution 

1 



Xt = XoeM{r-^c?)t + aWt). (31) 
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Example 3. A linear scalar SDE fS^ \4^: 



dXt = [ai{t)Xt + a2{t)]dt + [bi{t)Xt + b2{t)]dWt, Xt, given. (32) 
The fundamental solution 

$t,fo = exp[ / (ai(s) - \h\{s))ds + / h{s)dWs\. (33) 

The general solution 

Xt = {^to + f[a2{s) - h{s)b2{s)] ^-^ds (34) 

+ / h2{s) ^'^IdWs}, (35) 
Jto 

Example 4. A linear system of SDEs J6^ : 



dXt = [AXt + f{t)]dt + 9k{t)dWk{t), Xt, given, (36) 

k=l 

where A is a constant nxn matrix, X{t), f{t) and gk{t) 's are n— dimensional 
vector functions, and are independent scalar Brownian motions. This is 
a system with constant coefficient matrix and additive noise. In this case, 
we can find out the solution completely with the help of matrix exponential. 

The fundamental solution matrix for the corresponding linear system 
dXt = AXtdt is 

^t,to = e^^*-*"^. (37) 

The solution for the nonhomogeneous linear system with constant coefficient 
matrix Ii36\) is 

Xt = e^(*-*°){Xt„ + r e-^(^-*«)/(s)(is (38) 
Jto 

m ,.t 

+ E / e~''^'-'<^^gu{s)dWk{s)} (39) 
k=l -^^o 

= e^(*-*«)Xt„ + f e^^'-'^fis)ds (40) 

Jto 

m „t 

+ E / e^^'-'^9k{s)dWk{s). (41) 
k=l "'*o 
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Example 5. Stochastic oscillations f53|, [6^ 



x + ax + bx = aWt, (42) 

where a, b, a are real constants, and Wt is a scalar Brownian motion. This 
second order SDE may he rewritten as a first order SDE system: 

± = y, (43) 

y = -bx-ay + aWt- (44) 

In matrix form this becomes 

X = AX + KWt, (45) 



where 



and 



A 



K 



1 

-b —a 



The solution is 



X{t) = e^*X(0) + f e^^^-'^KdWs. (46) 

A special case of this model is the stochastic harmonic oscillator: 

x + kx = hWt, (47) 
where k,h are positive constants. In this case (a = 0), 

Noticing that = —kl with I the 2x2 identity matrix, we have 

^At^l cos(V^t) -i=sin(Vfci)\ ^^^^ 
\—^/ks\\i{\/kt) cos{\/kt) I 

The final solution for the stochastic harmonic oscillator is 

x{t) = xo cos(v^t) + ^ sm{y/kt) + sm{^{t - s))dWs, (49) 

y{t) = -xoVk sm{Vkt) + yo cos{Vkt) + h [ cos{Vk{t - s))dWs.{bO) 

Jo 
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3 Random dynamical systems 



In this section we introduce some definitions in stochastic dynamical sys- 
tems, as well as recall some usual notations in probability. 

We consider stochastic systems in the state space M". All the sample 
paths or sample orbits and invariant manifolds are in this state space. 

Some stochastic processes, such as a Brownian motion, can be described 
by a canonical (deterministic) dynamical system (see [1], Appendix A). A 
standard Brownian motion (or Wiener process) W{t) in M", with two-sided 
time t G M, is a stochastic process with VF(0) = and stationary indepen- 
dent increments satisfying W{t) — W{s) ~ M{0, \t — s\I). Here / is the nxn 
identity matrix. The Brownian motion can be realized in a canonical sample 
space of continuous paths passing the origin at time 



We identify Wt{uj) with uj(t), namely Wt{u>) = io{t). The convergence con- 
cept in this sample space is the uniform convergence on bounded and closed 
time intervals, induced by the following metric 



With this metric, we can define events represented by open balls in Q. For 
example, a ball centered at zero with radius 1 is {w : p{uj, 0) < 1}. We define 
the Borel cr— algebra as the collection of events represented by open balls 
^'s, complements of open balls, A^^s, unions and intersections of ^'s and/or 
A^^s, together with the empty event, the whole event (the sample space fi), 
and all events formed by doing the complements, unions and intersections 
forever in this collection. 

Taking the (incomplete) Borel a— algebra on Q, together with the 
corresponding Wiener measure P, we obtain the canonical probability space 
(ri,^, P), also called the Wiener space. This is similar to the game of gam- 
bling with a dice, where the canonical sample space is ^dice = {Ij 2, 3, 4, 5, 6}. 
Moreover, E denotes the mathematical expectation with respect to proba- 
bility P. 

The canonical driving dynamical system describing the Brownian motion 
is defined as 



n = Co(M,M") := {lu G C(]R,M") : a;(0) = 0}. 




n 



—n<t<n 




e{t) :Q^n, 9{t)Lo{s) := oj{t + s) - uj{t), s. 



t G M. 
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Then 9{t), also denoted as 9t, is a homeomorphism for each t and {t,uj) ^ 
9{t)uj is continuous, hence measurable. The Wiener measure P is invariant 
and ergodic under this so-called Wiener shift Ot- In summary, Ot satisfies 
the following properties. 

• ^0 = 'id, 

• BtOs = Ot+s, for all s, t G M, 

• the map (t, uj) ^ Otuj is measurable and 9t^ = P for all t G M. 

We now introduce an important concept. A filtration is an increasing 
family of information accumulations, called cr-algebras, J-f. For each t, a- 
algebra J-t is a collection of events in sample space fl. One might observe 
the Wiener process Wt over time t and use J-t to represent the information 
accumulated up to and including time t. More formally, on (0,^), a filtra- 
tion is a family of a-algebras : < s < i with contained in T for each 
s, and J-s C J-r for s < r. It is also useful to think Tt as the u-algebra gen- 
erated by infinite union of J-g^s, which is contained in Tf So a filtration is 
often used to represent the change in the set of events that can be measured, 
through gain or loss of information. 

For understanding stochastic differential equations from a dynamical 
point of view, the natural filtration is defined as a two-parameter family 
of fj-algebras generated by increments 

Tl := a{Lo{Ti) - uj{t2) ■.s<ti,T2< t), s,t€R. 

This represents the information accumulated from time s up to and including 
time t. This two-parameter filtration allows us to define forward as well as 
backward stochastic integrals, and thus we can solve a stochastic differential 
equation from an initial time forward as well as backward in time [1]. 

The solution operator for the stochastic system ([1]) with initial condition 
x(0) = xq is denoted as {p{t,LO,XQ). 

The dynamics of the system on the state space M", over the driving flow 
9t is described by a cocycle. A cocycle (p is a mapping: 

which is (i3(M) ® » i3(M"), i3(]R"))-measurable such that 

ip{0,uj,x) = x G M", 
ip{ti +t2,u;,x) = ip{t2,9t^u;,ip{ti,uj,x)), 
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for ti, t2 G M, a; G ft, and x G M". Then tp, together with the drivmg 
dynamical system, is called a random dynamical system. Sometimes we also 
use ip(t, to) to denote this system. 

Under very general smoothness conditions on the drift b and diffusion a, 
the stochastic differential system ([T]) generates a random dynamical system 
in M"; see [U 09]. Let us see an example. 

Example 6. Consider a SDE: 

dXt = Xtdt + dWt, Xo = x eR, t G M 
The solution is Xt{uj) = e*x + Jq e^~'^dWr{io). Thus the solution operator is 



ip{t,uj,x) := e'^x + / e* '^dWr{uj). 
Jo 



Note that 

ip{0, uj, x) = X. (51) 

Now let us show that 

ip{t + s, w, x) = ip{t, OgOJ, ip{s, UJ, x)). (52) 
Indeed, on one hand, 

l-t+S 



e*+'-^dWr{uj). 



(p{t + s,uj,x) = e'^^'^x + 

Jo 

On the other hand, 

ip{t,9sUJ,^{s,oj,x)) = e^(p{s,oj,x) + / e^~'^dWr{OsU!) 



e*[e"x+ / e'-^dWr]+ [ e^-^dWA 
Jo Jo 



Now we only to show the following Claim; e* '^dW{9sUj) = f^^^ e*"*"* '^dWr{uj). 
We prove that both sides of this claim are identical. In fact, noticing that 

dWr{esUj)=d{Ws+r-Ws), 

Left hand side = lim —m.s. e*^^^ (W^s+t,+i — Ws+rj) (53) 

j 

Right hand side = lim -m.s.^e^+'^^'+^^\Ws+r,+,-Ws+rj) = lim -m.s. ^e^'^^Wrj+.-Wrj) 

j j 

(54) 
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Hence the claim is proved. Therefore, the solution operator (p{t, uj, x) satis- 
fies the cocycle property: 

ip{t + S, U!, x) = ip{t, OsU), ip{s, LO, x)) (55) 

We recall some concepts in dynamical systems. A manifold M is a set, 
which locally looks like an Euclidean space. Namely, a "patch" of the man- 
ifold M looks like a "patch" in M". For example, curves, torus and spheres 
in are one- and two-dimensional differentiable manifolds, respectively. 
However, a manifold arising from the study of invariant sets for dynamical 
systems in M", can be very complicated. So we give a formal definition of 
manifolds. For more discussions on differentiable manifolds, see p!| I73j. 

Definition 1. (Differentiable manifold and Lipschitz manifold) An 

n-dimensional differentiable manifold M , is a connected metric space with 
an open covering {Ua}, i-e, M = (J^ Ua, such that 

(i) for all a , Ua is homeomorphic to the open unit ball in M", B = {x £ 
R" : l^l < 1}, i.e., for all a there exists a homeomorphism of Ua onto B, 
ha '■ Ua ^ B, and 

(ii) ifUa^Ujs 7^ and ha '■ Ua ^ B , hp : Up ^ B are homeomorphisms, 
then ha{Ua n Up) and hp{Ua n Up) are subsets ofW^ and the map 

h = haoh~p^ : hp{Ua n Up) ha{Ua n Up) (56) 

is differentiable, and for all x G hp{Ua H Up), the Jacobian determinant 
det Dh{x) / 0. 

// the map ^56\) is only Lispchitz continuous, then we call M an n- 
dimensional Lispchitz continuous manifold. 

Recall that a homeomorphism of A to B is a continuous one-to-one map 
of A onto B, h : A ^ B, such that : B ^ A is continuous. 

Just as invariant sets are important building blocks for deterministic 
dynamical systems, invariant sets are basic geometric objects to help under- 
stand stochastic dynamics [1]. Here we present two different concepts about 
invariant sets for stochastic systems: random invariant sets and almost sure 
invariant sets. 

Definition 2. (Random set) A collection M = M{uj)i^,=q, of nonempty 
closed sets M{lo), w G il, contained in M", is called a random set if 

UJ ^ inf d{x, y) 
yeM(oj) 

is a random variable for any x G M". 
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Definition 3. (Random invariant set) A random set M{uj) is called an 
invariant set for a random dynamical system if if 

(p{t,uJ,M{uj)) C M{6tuj), t eR and uj en. 

Random stationary orbits and periodic orbits [25] are special invariant 
sets. 

Definition 4. (Stationary orbit) A random variable y{oo) is called a sta- 
tionary orbit for a random dynamical system ip if 

ip{t,uj,y{uj)) = y{9toj), a.s., for all t. 

Let us consider an example. 

Example 7. Consider a SDE 

du(t) = -u(t)dt + dW{t),u{0) = UQ. (57) 

This SDE defines a random dynamical system 

ip{t,uj,uo):=u = e-^u{0)+ [ e~(*~'')dT^(s). (58) 







A stationary orbit of this random dynamical system is given by 

Y{uj) = [ e'dWsico). (59) 



Indeed, it follows from 158\) and 159\) that 



ip{t,io,Y{uj)) = e-*y(w)+ / e-(*-")(iW,(w) 







ft 

e'dWs{uj)+ / e-^^-'^dWs{uj) 

oo Jo 



[ e-'-'-'UWsiuj) + [ e-^'-'UWs{uj) 

J-oo Jo 

t 

e-^^-'UWs{uj). (60) 



oo 
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By [58\) we also see that 

Y{etuj) = f e'dWsiOtu:) 

J —oo 



oo 


'OO 

t 

e-^^-'UWs{uj). (61) 



Thus ip{t,uj,Y{u!)) = Y{9tu>), i.e., Y{u!) = J^^e^dWs{u!) is a stationary 
orbit for the random dynamical system (|57p . 



Definition 5. (Periodic orbit) A random process y{t,u) is called an in- 
variant random periodic orbit of period T for a random dynamical system 93 

y{t + T,uj) = y{t,uj), a.s. 
ip{t,uj,y{to,uj)) = y{t + to,etuj), a.s. 

for all t and to- 

Definition 6. (Random invariant manifold) If a random invariant set 
M can be represented by a graph of a Lipschitz mapping 

7*(u;, •) : — > , with direct sum decomposition © = M" 

such that 

M{uj) = {2;+ +7*(w,x+),x+ G 
then M is called a Lipschitz continuous invariant manifold. 



We will also consider deterministic invariant sets or manifolds, while the 
invariance is in the sense of almost-sure (a.s.) [71 128j. 

Definition 7. (Almost sure invariant set and manifold) A (deter- 
ministic) set M in M" is called locally almost surely invariant for ([T]), if for 
all (tQ,XQ) S M X M, there exists a continuous local weak solution X^^^-^o) 
with lifetime r = r (to ,2:0)) such that 

j^^(to,xo) g ^ ^^^^ ^^^^ 

where t At = min(t, r). When M is a manifold, it is called an almost sure 
invariant manifold. 
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4 Impact of model uncertainty and error growth 

Consider a n— dimensional SDE system 

dXt = b{Xt)dt + a{Xt)dWt, (62) 

A typical application of the Ito's formula for SDEs is to estimate mo- 
ments of solutions. For example, for the second moment, by taking g = 

1 II Ii2 1 

2 1 1 1 1 — 2 ' 

^WXtf = dg{Xt) = [Xfb+ ^Triaa'^)]dt + Xta{Xt)dWt (63) 
Taking mean, we get 

^^E||Xtf = ^{Xt • 6) + Tr{a{Xt)a^{Xt)) (64) 

This tells us how the fluctuating force affects the evolution of the mean 
energy of the system. The final term Tr[a{Xt)(T'^ {Xt)] is the effect of noise 
on mean energy. 

Consider the deterministic system without model uncertainty 

dYt = b{Yt)dt, (65) 

Then the solution error Uf = Xf — Yf satisfies 

dUt = [b{Ut + Yt) - biYt)]dt + a{Ut + Yt)dWt, (66) 

Thus 

l^nUtf = • [b{Ut + Yt) - b{Yt)]) + ^ETr[a{Ut + Yt)a^{Ut + Yt)].{67) 

This describes the error growth under uncertainty. The final term Tr[a{Ut + 
Yt)a^{Ut + Yt)] is the effect of noise on error growth. 

Let us look at an example. 

Example 8. Lorenz system under uncertainty 

Consider the Lorenz system with multiplicative noise 

dx = {—sx + sy)dt + \/e xdWi{t), 
dy = {rx — y — xz)dt + y/e ydW2{t), 
dz = {—bz + xy)dt + a/e zdW3{t), 
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where Wi, W2 and W3 are independent scalar Brownian motions, and r, s, 6, e 
are positive parameters. The classical chaos case is when r = 28, s = 10 and 
b = 8/3. 

Let X := {x,y,z)'^ . Then by the Ito's formula, we obtain energy estimate 

~E\\Xf = E[-sx^-y^-bz'^ + {r + s)xy + ^e{x'^ + y^ + z'^)] 
< [~mm{s,l,b) + ^{r + s + e)]E\\Xf , 

where we have used the fact that xy < ^(x^ + y^) < ^{x"^ + 2/^ + z"^). We 
can see that in this case, the noisy terms add "energy" into the system. 

Now we consider error growth due to uncertainty. Let X := {x,y, zj^ be 
the (deterministic) solution (e = Q case), and let U = {u,v,w)'^ := X — X 
be the error. Then by the Ito 's formula, we obtain error growth estimate 

-— E||[/|| = E[— SM —V — bw + [r + s)uv + yuw — zuv + -e{u +v + 
< [- mm(s, l,b) + ^{r + s + \y\ + \z\ + e)] E\\Uf, 

where we have used the fact that K{yuw) < \y\ Kluw] < ^\y\ E(u^ + w'^). 
Note that under suitable conditions, this system has a random attractor \8^ . 



5 Residence time, exit probability and predictabil- 
ity 

We start with a SDE system 

dXt = b{Xt)dt + aiXt)dWt, Xo given (68) 

where b is an n— dimensional vector function, o" is an n x m matrix function, 
and Wt{uj) is an m— dimensional Brownian motion. The generator for this 
SDE is a linear second order differential operator as in f|2] 

Ag = (Vgfb + ^Tr[aa^D\g)], (69) 

where is the Hessain differential matrix and Tr denotes the trace. 

For a bounded domain D in M", we can consider the exit problem of 
random solution trajectories of (j68|) from D. To this end, let dD denote 
the boundary of D and let F be a part of the boundary dD. The escape 
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probability p{x, y) is the probability that the trajectory of a particle starting 
at {x, y) in D first hits dD (or escapes from D) at some point in T, and p{x, y) 
is known to satisfy ([511 [83l [13] and references therein) 



Ap = 0, 
p\r = 1, 
p\dD-r = 0. 



(70) 
(71) 
(72) 



Suppose that initial conditions (or initial particles) are uniformly distributed 
over D. The average escape probability P that a trajectory will leave D 
along the subboundary F, before leaving the rest of the boundary, is given 



where is the area of domain D. 

The residence time of a particle initially at (x, y) inside D is the time 
until the particle first hits dD (or escapes from D). The mean residence 
time u{x,y) is given by (e.g., [83l[6ll[74] and references therein) 



Relevance to predictability problem. For low dimensional SDE systems, 
such as the Lagrangian dynamical model for fluid particles in random fluid 
flows or other truncated model like the Lorenz model, the exit probability 
and mean residence time may be computed by deterministic partial differen- 
tial equations solvers [13]. Be selecting the above domain D appropriately, 
say corresponding to observational data ("data domain"), we may determine 
predictability time window, by monitoring when the system exits the data 
domain. 

6 Invariant manifolds and predictability 

Invariant manifolds provide geometric structures that describe dynamical 
behavior of nonlinear systems. Dynamical reductions to attracting invari- 
ant manifolds or dynamical restrictions to other (not necessarily attracting) 
invariant manifolds are often sought to gain understanding of nonlinear dy- 
namics. 

There have been recent works on invariant manifolds for stochastic differ- 
ential equations [H \90\ [Ml [25] . Random invariant manifolds in the sense of 



by (e.g., mm) 




(73) 



u\dD = 0. 



Au = -1 



(74) 
(75) 
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Definition [6] are difficult to obtain, even locally in state space. But almost 
sure invariant manifolds in the sense of Definition [7] may be determined, 
locally in state space (which also means for finite time in evolution), for 
some SDE systems, by a method of solving first order deterministic partial 
differential equations [21] • 

We consider the following stochastic system defined by Ito stochastic 
differential equations in M": 

dX = h{X)dt + a{X)dW{t), X{<d) = XQ, (76) 

where again h and a are vector and matrix functions in M" and M"^"", re- 
spectively, and W{t) are standard vector Brownian motion in M". We also 
assume that b{-) G CHM'^;M") and a{-) G Ci(M"; M'^^'"). 

For the nonlinear stochastic system (j76p . we study deterministic almost 
sure invariant manifolds, which are not necessarily attracting. We reformu- 
late the local invariance condition as invariance equations, i.e., first order 
partial differential equations, and then solve these equations by the method 
of characteristics. Although the local invariant manifold is deterministic, 
the restriction of the original stochastic system on this deterministic local 
invariant manifold is still a stochastic system but with reduced dimension. 

We are going to derive representations of invariant finite dimensional 
manifolds in terms of b and a, by using the tangency conditions for a deter- 
ministic smooth manifold (a supersurface) M in M": 

/x(u;,x) :=6(u;,x) - ^ J^[L»ct^'(cj, x)] a^'(u;, x) E T^M, (77) 

i 

a^{oo,x) G T,M, j = I,-- - ,n, (78) 

where D represents Jacobian operator and is the j— th column of the 
matrix a. The above tangency conditions are shown to be equivalent to 
almost sure local invariance of manifold M; see e.g., |281 [7]. 

The almost sure invariance conditions (j77p - (178p for manifold M mean 
that the n + 1 vectors, ji and , j = 1, • • • ,ri, are tangent vectors to M. 
Namely, these n + 1 vectors are orthogonal to the normal vectors of manifold 
M. 

In other words, if the normal vector for M at rr is N(x), then the al- 
most sure invariance conditions (I77p - ()78p become the following invariance 
equations for manifold M : For all x G M, 

<fi{x),N{x)> = 0, (79) 
<a^ix),N{x) > = 0, j = l,--- ,n, (80) 
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where, as before, < •, • > denotes the usual scalar product in M". 

Invariant manifolds are usually represented as graphs of some functions 
in R". By investigating the above invariance equations (|79p - (j80p . we may 
be able to find some local invariant manifolds M for the stochastic system 

(ESI). 

The goal for this section is to present a method to find some of these local 
invariant manifolds. Although the following result and example are stated 
for a codimension 1 local invariant manifold, the idea extends to other lower 
dimensional local invariant manifolds, as long as the normal vectors N{x) 
(or tangent vectors) may be represented; see tangency conditions ([79|) - ([80]) 
above and (l82])-([83]) below. 

Local almost sure invariant manifold: 

Let the local invariant manifold M for the stochastic dynamical system (I76p 
be represented as a graph defined by the algebraic equation 

M: G(xi,--- =0. (81) 

Then G satisfies a system of first order (deterministic) partial differential 
equations and the local invariant manifold M may be found by solving these 
partial differential equations by the method of characteristics. By restricting 
the original dynamical system (j76p on this local invariant manifold M, we 
obtain a locally valid, reduced lower dimensional system. 

In fact, the normal vector to this graph or surface is, in terms of partial 
derivatives, VG(x) = {Gx^-,--- iGxn)- Thus the invariance equations (179]) - 
([80]) are now 

< /i(2;),VG(x) > = 0, (82) 
<aJ{x),VG{x)> = 0, j = l,---,n, (83) 

This is a system of first order partial differential equations in G. We apply 
the method of characteristics to solve for G, and therefore obtain the invari- 
ant manifold M, represented by a graph in state space W^: G{xi, • • • , Xn) = 
0. 

Method of Characteristics. Consider a first order partial differential equation 
for the unknown scalar function n of n variables xi, • • • ,Xn 

n 

'^ai{xi, ■ ■ ■ ,Xn)uxi = c{xi, ■ ■ ■ ,Xn), (84) 
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with continuous coefficients aj's and c. 

Note that the solution surface u = u{xi, ..,Xn,t) in xi... ••• x„,u— space 
has normal vectors N := (u^i, • • • , Ux„, — !)• This partial differential equa- 
tion implies that the vector V =: (oi,--- ,a„,c) is perpendicular to this 
normal vector and hence must lie in the tangent plane to the graph of 

Z = u{xi, ■ ■ ■ ,Xn). 

In other words, (ai,--- ,an,c) defines a vector field in M", to which 
graphs of the solutions must be tangent at each point [55]. Surfaces that 
are tangent at each point to a vector field in are called integral surfaces 
of the vector field. Thus to find a solution of equation (j84p . we should try 
to find integral surfaces. 

How can we construct integral surfaces? We can try using the char- 
acteristics curves that are the integral curves of the vector field. That is, 
X = (xi(t), • • • ,Xn{t)) is a characteristic if it satisfies the following system 
of ordinary differential equations: 

dxi 

— = ai(xi,--- ,Xn), 

dXn , ■. 

— Q,n(xi , . . , j , 
du . , 

— — = C[Xi,..,Xn)- 

at 

A smooth union of characteristic curves is an integral surface. There may 
be many integral surfaces. Usually an integral surface is determined by 
requiring it to contain (or pass through) a given initial curve or an n — 1 
dimensional manifold F: 

Xi = fi{si, ..,Sn-i),i = l-.n 

U = h{si, ..,Sn-l) 

This generates an n-dimensional integral manifold M parameterized by 
(si, .., Sn-i,t). The solution u{xi, • • • , Xn) is obtained by solving for (si, .., Sn-i 
in terms of variables (xi, • • • , x„). 

Remark 3. If initial data T is non- characteristic, i.e., it is nowhere tangent 
to the vector field V = (oi,-- - ,an,c), and ai,--- ,an,c are (and thus 
locally Lipschitz continuous), then there exists a unique integral surface u = 
u{xi, ■ ■ ■ ,Xn) containing T, defined at least locally near T. 

Now applying the above method of characteristics to (j82p - (j83p . we obtain 
a solution G = G{xi, ■ ■ ■ , Xn). However, the local invariant manifold M that 
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we look for is represented by the equation 



Xn) = 0. 



Therefore, a skih is needed to make sure that the solution G = G{xi, ■ ■ ■ , Xn) 
actually penetrates the plane G = in the xi ■ ■ -x^G— space; see Fig. 1. 
This needs to be achieved by selecting appropriate initial data F. The 
invariant manifold M we thus obtain is defined at least locally near the 
initial data F. 

Relevance to predictability problem. When a SDE system starts to evolve 
inside a local almost sure invariant manifold M, it remains inside the mani- 
fold for a certain time period < t < T. As determined above, this manifold 
holds solutions for the system, the time period T may be taken as a lower 
bound of the predictability time scale. 

7 Systems driven by non- Gaussian noise 

Although Gaussian processes like Brownian motion have been widely used 
in modeling fluctuations in geophysical modeling, it turns out that many 
physical phenomena involve with non-Gaussian Levy motions. For instance, 
it has been argued that diffusion by geophysical turbulence [84] corresponds, 
loosely speaking, to a series of "pauses", when the particle is trapped by a 
coherent structure, and "flights" or "jumps" or other extreme events, when 
the particle moves in the jet fiow. Paleoclimatic data [20] also indicates such 
irregular processes. 

Levy motions are thought to be appropriate models for non-Gaussian 
processes with jumps |79| . Let us recall that a Levy motion L{t) has indepen- 
dent and stationary increments, i.e., increments AL(t, At) = L{t+At) — L{t) 
are stationary (therefore AL has no statistical dependence on t) and inde- 
pendent for any non overlapping time lags At. Moreover, its sample paths 
are only continuous in probability, namely, ¥{\L{t) — L(to)| > <J) — > as 
t ^ to for any positive 5. This continuity is weaker than the usual continu- 
ity in time. 

This generalizes the Brownian motion B{t), as B{t) satisfies all these 
three conditions. But Additionally, (i) Almost every sample path of the 
Brownian motion is continuous in time in the usual sense and (ii) Brownian 
motion's increments are Gaussian distributed. 

SDEs driven by non-Gaussian Levy noises 



dXt = b{Xt)dt + a{Xt)dL{t) 



(85) 
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Xn)=0 



Xn 



Figure 1: Local invariant manifold M is represented by the equation 
G{xi, • • • , Xn) = in the x\ - ■ ■ x^— space. Namely, M is the intersection of 
the surface G = • • • , x„) with the plane G = in xi • • • x^G— space. 

Here G{xi, ■ ■ ■ , Xn) is the solution of ([52|) - ([55|) via the method of character- 



istics. Note that N = (ti 



-1) and V = (ai, 



,c). 
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have attracted much attention [3l H2t [HT] but this research subject is less 
developed. Recently, mean exit time estimates have been investigated by 
Imkeller et al ^\ HI] and Yang and Duan [M] . 

Further progresses in SDEs driven by non-Gaussian noises will benefit 
the research in predictability in weather and climate systems with non- 
Gaussian (which is more common) model uncertainty. 

8 Systems driven by colored noise 

Colored noise, or noise with non-zero correlation in time, has been considered 
or used in the physical community [341 131j . A good candidate for modeling 
colored noise is the fractional Brownian motion. A fractional Brownian 
motion (fBm) process , where H G (0, 1) is fixed, is still a Gaussian 
process. But it is characterized by the stationarity of its increments and a 
memory property. The increments of the fractional Brownian motion are 
not independent, except in the standard Brownian case {H = i). Thus it 
is not a Markov process except when H = ^. Specifically, (0) = and 
Var [B^ (t) — B^ (s)] = |t — It also exhibits power scaling and path 

regularity properties with Holder parameter H, which are very distinct from 
Brownian motion. The standard Brownian motion is a special fBm with 
H = 1/2. 

The stochastic calculus involving fBm is currently being developed; see 
e.g. \6A\ [87] and references therein. This will lead to more advances in the 
study of SDEs driven by colored fBm noise: 

dXt = b{Xt)dt + a{Xt)dB"{t). (86) 

bmce the fBM B^{t) is not Markov, the solution process Xt is not Markov 
either. Thus the usual techniques from Markov processes will not be appli- 
cable to the study of SDEs driven by fBms. However, the random dynamical 
systems approach, as described in ^ above, looks promising [5l]. The the- 
ory of RDS, developed by Arnold and coworkers [5, describes the qualitative 
behavior of systems of stochastic differential equations in terms of stability, 
Lyapunov exponents, invariant manifolds, and attractors. 

Further progresses in SDEs driven by colored noises will benefit the re- 
search in predictability in weather and climate systems with more general 
(non-white noise) model uncertainty. 
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